Display device and method for controlling same

ABSTRACT

An example method for controlling a display device includes displaying an execution screen of an application which is divided into a plurality of regions; extracting source information related to a region, from among the plurality of regions, to be transmitted to a peripheral device; and transmitting the extracted source information to the peripheral device. Accordingly, the display device can more efficiently provide multi-UI services between a plurality of peripheral devices.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.15/749,230, filed on Jan. 31, 2018, which is a national stageapplication of International Patent Application No. PCT/KR2016/008723,filed on Aug. 9, 2016, which designates the United States, and whichclaims priority to Korean Patent Application No. 10-2015-0117973, filedAug. 21, 2015. The contents of each of these applications areincorporated herein in their entirety.

TECHNICAL FIELD

The present disclosure relates to a display device and a controllingmethod thereof and, more particularly, to a display device whichperforms a multi UI service with a peripheral device and a controllingmethod thereof.

BACKGROUND ART

Various applications have been developed according to the development ofelectronic devices. In recent years, an application has been developedin which a plurality of users can participate together through aninteraction between electronic devices.

However, in order for a plurality of users to participate through suchan application, the corresponding application must be installed in eachelectronic device for each user. In addition, the development ofapplications suitable for the installed operating system for eachelectronic device and the management of each application developed foreach operating system should be continuously maintained. Accordingly,there is a problem that not only an additional cost is incurred indeveloping an application for each operating system with respect to oneapplication, but also an increase in cost due to maintenance for anapplication developed for each operating system occurs.

Meanwhile, in the conventional method of providing a multi-UI serviceamong the plurality of electronic devices, the service merely transmitsthe previously stored contents from the main device to the target devicethrough the mirroring method. Furthermore, since the conventionalmulti-UI service providing method is a method of transmitting thecorresponding contents to the target device, there is a problem that thedata amount increases due to the transmission, which causes slowdown ofdata transmission speed.

SUMMARY

It is an object of the present invention to provide a multi-UI servicebetween a plurality of electronic devices more efficiently.

According to an exemplary embodiment, a method for controlling a displaydevice includes displaying an execution screen of an application whichis divided into a plurality of regions; extracting source informationrelated to a region, from among the plurality of regions, to betransmitted to a peripheral device; and transmitting the extractedsource information to the peripheral device.

The extracting may include, in response to the peripheral deviceapproaching, determining a position where the peripheral deviceapproaches, extracting source information of a first region relating tothe determined position from among the plurality of regions, wherein theperipheral device displays information of the first region based onsource information received from the display device.

The extracting may include, in response to the peripheral deviceapproaching, extracting source information of a first region, from amongthe plurality of regions, executable by the peripheral device based ondevice information of the peripheral device, wherein the peripheraldevice displays information of the first region based on sourceinformation received from the display device.

The extracting may include, in response to the peripheral deviceapproaching, extracting source information of a region executable by theperipheral device based on device information of the peripheral deviceand execution information of the plurality of regions and transmittingthe information to the peripheral device.

The transmitting may include, in response to a first region, from amongthe plurality of regions, being a region for receiving a user command ordisplaying user information, transmitting source information of thefirst region to a first peripheral device, from among the approachingperipheral devices, corresponding to a preset first condition, and inresponse to a second region, from among the plurality of regions,displaying a content, transmitting source information of the secondregion to a second peripheral device, from among the approachingperipheral devices, corresponding to a preset second condition.

The extracting may include extracting source information of a first areacorresponding to a user command from among the plurality of areas, andwherein the transmitting may include transmitting source information ofthe first area to a peripheral device corresponding to a user commandfrom among the peripheral devices capable of communicating.

The method may further include editing and displaying the executionscreen based on an area other than an area related to source informationtransmitted to the peripheral device from among the plurality of areas.

The editing and displaying the execution screen may include, when anexecution screen return command is input or an event is detected inwhich the peripheral device transmitting the source information is notclose, re-editing and displaying the edited execution screen as aninitial execution screen of the application, and when an event totransmit source information related to the changed area to theperipheral device occurs, re-editing and displaying the edited executionscreen based on an area other than the changed area from among theplurality of areas.

The method may further include controlling an operation of theapplication based on the received user command, when a user command isreceived from a peripheral device which transmits the sourceinformation.

The source information may include at least one of an execution code andresource for executing a first area to be transmitted to the peripheraldevice, and the extracting may include extracting source informationrelating to the first area by analyzing predetermined source informationrelating to the first area and an execution code for executing the firstarea.

According to still another exemplary embodiment, a display deviceincludes a communicator configured to perform data communication with aperipheral device capable of communication; a display configured todisplay an execution screen of an application which is divided into aplurality of areas; and a controller configured to control thecommunicator to extract source information related to an area to betransmitted to the peripheral device from among prestored sourceinformation related to a plurality of areas constituting the applicationexecution screen and transmit the extracted source information to theperipheral device.

The display device further includes at least one sensor configured tosense proximity of the peripheral device, wherein the controller, if itis sensed that the peripheral device is adjacent, determines a positionwhere the peripheral device is adjacent, extracts source information ofthe first area relating to the determined position and transmits to thefirst peripheral device, and the peripheral device displays informationof the first area based on the source information received from thedisplay device.

The display device further includes at least one sensor configured tosense proximity of the peripheral device, wherein the controller, if itis sensed that the peripheral device is adjacent through the sensor,extracts source information of the first area executable by theperipheral device from among the plurality of areas based on deviceinformation of the peripheral device, transmits the extracted sourceinformation to the peripheral device, and the peripheral device displaysinformation of the first area based on the source information receivedfrom the display device.

The display device further includes at least one sensor for sensingproximity of the peripheral device, wherein the controller, if it issensed that the peripheral device is adjacent through the sensor,extracts source information of the executable area by the peripheraldevice based on device information of the peripheral device andexecution information by the plurality of areas and transmits theinformation to the peripheral device.

The controller, if the first area from among the plurality of areas isan area for receiving a user command or displaying user information,transmits source information of the first area to the first peripheraldevice corresponding to a preset first condition and if a second area isan area for displaying a content, transmits source information of thesecond area to the second peripheral device according to a preset secondcondition.

The device further includes an input unit for receiving a user command,and the controller, according to a user command input through the inputunit, may control the communicator to extract source information of thefirst area corresponding to the user command and transmit the extractedsource information to the peripheral device corresponding to the usercommand.

The controller may control the display to edit and display the executionscreen based on an area other than an area relating to sourceinformation transmitted to the peripheral device from among theplurality of areas.

The controller, when an execution screen return command is input or anevent is detected in which the peripheral device transmitting the sourceinformation is not close, may re-edit and display the edited executionscreen as an initial execution screen of the application, and when anevent for transmitting source information related to an area changed tothe peripheral device occurs, the display device may re-edit the editedexecution screen based on the remaining area except for the changed areaamong the plurality of areas, and display the execution screen of there-edited application.

The controller, when a user command is received from a peripheral devicewhich transmits the source information, may control an operation of theapplication based on the received user command.

The source information includes at least one of an execution code andresource for executing a first area to be transmitted to the peripheraldevice, and the controller may analyze predefined source information oran execution code for executing the first area and extract sourceinformation relating to the first area.

According to various exemplary embodiments, the display device accordingto the present disclosure may provide a multi UI service between aplurality of peripheral devices more efficiently.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram briefly illustrating a configuration of amulti UI service system according to an exemplary embodiment,

FIG. 2 is a block diagram briefly illustrating a configuration of adisplay device according to an exemplary embodiment,

FIG. 3 is a block diagram illustrating a detailed configuration of adisplay device according to an exemplary embodiment,

FIGS. 4A and 4B are exemplary diagrams which extract source informationrelating to an area to be transmitted to a peripheral device from amonga plurality of areas constituting an execution screen of an applicationaccording to an exemplary embodiment,

FIG. 5 is an exemplary diagram illustrating an execution screen of adisplay device according to an exemplary embodiment,

FIG. 6 is a first exemplary diagram performing a multi UI servicebetween a display device and a peripheral device according to anexemplary embodiment,

FIG. 7 is a second exemplary diagram performing a multi UI servicebetween a display device and a peripheral device according to anexemplary embodiment,

FIG. 8A is a first exemplary diagram of performing a multi UI servicebetween a display device and a plurality of peripheral devices accordingto an exemplary embodiment,

FIG. 8B is a first exemplary diagram of performing an operationcorresponding to an event by a plurality of peripheral devicesperforming a multi UI service with the display device according to anexemplary embodiment,

FIG. 8C is a second exemplary diagram of performing an operationcorresponding to an event by a plurality of peripheral devicesperforming a multi UI service with the display device according to anexemplary embodiment,

FIGS. 9A and 9B are second exemplary diagrams of performing a multi UIservice between a display device and a plurality of peripheral devicesaccording to an exemplary embodiment according to an exemplaryembodiment,

FIG. 10 is a third exemplary diagram of performing a multi UI servicebetween a display device and a plurality of peripheral devices accordingto an exemplary embodiment according to an exemplary embodiment,

FIG. 11 is a fourth exemplary diagram of performing a multi UI servicebetween a display device and a plurality of peripheral devices accordingto an exemplary embodiment according to an exemplary embodiment,

FIG. 12 is a fourth exemplary diagram of performing a multi UI servicebetween a display device and a plurality of peripheral devices accordingto an exemplary embodiment according to an exemplary embodiment,

FIG. 13 is a first flowchart of a controlling method of a display deviceaccording to an exemplary embodiment,

FIG. 14 is a second flowchart of a controlling method of a displaydevice according to still another exemplary embodiment.

DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS

Hereinafter, an exemplary embodiment of the present disclosure will bedescribed in a greater detail with reference to the drawings attached.

FIG. 1 is a block diagram briefly illustrating a configuration of amulti UI system according to an exemplary embodiment.

As illustrated in FIG. 1, the multi UI service system includes a displaydevice 100 and a plurality of peripheral devices 200.

Here, the display device 100 is a terminal capable of performing datacommunication with the plurality of peripheral devices 200, and may be aterminal device such as a smart TV, a smart phone, a tablet PC, or aterminal device installed in a home appliance such as a washing machine,a refrigerator, or an air-conditioner. The display device 100 may be aterminal device which provides source information related to at leastone region from among a plurality of regions constituting an executionscreen of an application which is executed according to a user commandto at least one peripheral device 200 from among the plurality ofperipheral devices 200.

The plurality of peripheral devices 200 capable of data communicationwith the display device 100 may be the first to third peripheral devices200-1 to 200-3 as shown in the drawings, and the first to thirdperipheral devices 200-1 to 200-3 may be a terminal device such as asmart TV, a smart phone, and a tablet PC, or a terminal device mountedin a home appliance such as a washing machine, a refrigerator, or an airconditioner.

At least one of the first to third peripheral devices 200-1 to 200-3 maydisplay an execution screen or information corresponding to a specificarea from among a plurality of areas constituting an execution screen ofan application which is being executed by the display device 100 basedon the source information received from the display device 100.

As described above, the display device 100 and the peripheral device 200may be terminal devices such as a smart TV, a smart phone, a tablet PC,or a terminal device mounted in a home appliance such as a washingmachine, a refrigerator, or an air conditioner. The display device 100will be described in greater detail.

FIG. 2 is a block diagram briefly illustrating a configuration of adisplay device according to an exemplary embodiment, FIG. 3 is a blockdiagram illustrating a detailed configuration of a display deviceaccording to an exemplary embodiment.

As described in FIG. 2, the display device 100 may include acommunication unit 110, a display 120, a control unit 130, a sensor 140,an input unit 150, and a storage 160.

The communication unit 110 performs data communication with a pluralityof peripheral devices 200 existing on the same network by wire/wireless.Accordingly, the communication unit 110 can transmit source informationrelated to at least one of a plurality of areas constituting anexecution screen of an application being executed to at least oneperipheral device 200 among a plurality of peripheral devices 200capable of data communication.

Here, the source information may include at least one of an executioncode and a resource for execution of a first area to be transmitted tothe peripheral device 200 among a plurality of areas constituting anexecution screen of the application.

As illustrated in FIG. 3, the communication unit 110 which performs datacommunication with the plurality of peripheral devices 200 includes ashort distance communication module 111, a wireless LAN module 113, ahigh-definition multimedia interface (HDMI), a universal serial bus(USB), and a connector 115 which includes at east one of wiredcommunication module such as Institute of Electrical and ElectronicsEngineers (IEEE) 1394, and the like.

The short distance communication module 111 is a configuration forwirelessly performing short distance communication between the displaydevice 100 and the plurality of peripheral devices 200. The shortdistance communication module 111 may include at least one of aBluetooth module, a Near Field Communication (NFC) module, a WIFImodule, and a Zigbee module.

The wireless LAN module 113 is a module that is connected to an externalnetwork and performs communication according to a wireless communicationprotocol such as IEEE. In addition, the wireless communication modulemay further include a mobile communication module for performingcommunication by accessing a mobile communication network according tovarious mobile communication standards such as 3rd Generation (3G), 3rdGeneration Partnership Project (3GPP), Long Term Evolution (LTE), and soon.

The communication unit 110 may be implemented by various wirelesscommunication methods, and can apply other communication technologiesnot mentioned in this specification, if necessary.

Meanwhile, the connector 115 is configured to provide an interface withvarious peripheral devices such as USB 2.0, USB 3.0, HDMI, and IEEE1394. Such connector 115 may receive image content related data from aterminal device including a plurality of peripheral devices 200 througha cable connected to the connector 115 in accordance with a controlcommand of the control unit 143. In addition, the connector 115 canreceive power from a power source via a wired cable physically connectedto the connector 115.

The display 120 may display an execution screen of an executedapplication according to a user command. In addition, the display 120may display image content received from an external source such as acontent server (not shown) and image processed by the control unit 130.The display 120 may be implemented as a liquid crystal display (LCD), anorganic light emitting diode (OLED), or a plasma display panel (PDP). Ifthe input unit 150 to be described later is implemented as a touch pad,the display 120 may be implemented as a touch screen having a mutuallayer structure together with the input unit 150, which is a touch pad.

The control unit 130 controls the operation of each of the componentsconstituting the display device 100. In particular, the control unit 130extracts source information related to an area to be transmitted to theperipheral device 200 among the source information stored in the storageunit 160 in relation to a plurality of areas constituting an executionscreen of the application. In accordance with such a control command,the communication unit 110 can transmit to the peripheral device 220 thesource information pre-extracted by the peripheral device 220. Here, theperipheral device 200 may be a device which is in proximity to thedisplay device 100 or selected according to a user command from amongthe plurality of peripheral devices 200 communicable with the displaydevice 100. Accordingly, such peripheral device 200 can display anexecution screen or information corresponding to a specific area among aplurality of areas constituting an execution screen of the application,based on the source information received from the display device 100.

The sensor 140 may be a proximity sensor that senses whether at leastone of the plurality of peripheral devices 200 is in proximity to theperipheral device 100. The sensor 140 may be formed on one side of thedisplay device 100 or on each side thereof.

As shown in FIG. 3, the input unit 150 includes an operation unit 151for receiving a user's operation command, and a control unit 150 forreceiving a user's touch command and a touch input unit 153 forreceiving a user's touch command. Here, the operation unit 151 may beimplemented as a keypad having various function keys, numeric keys,special keys, and character keys. The touch input unit 153, when thedisplay 220 is implemented as a touch screen, may be a touch pad havinga mutual layer structure with the display 220.

The storage unit 160 may store an application program for executing eachof a plurality of applications. In addition, the storage unit 160 maystore at least one of various multimedia data and contents processed bythe control unit 130, and image contents received from an externalsource or generated according to a user command. Further, the storageunit 160 may store an operating system program for controlling theoperation of the display device 100. Here, the operating program may bea program that is read and compiled in the storage unit 160 to operateeach configuration of the display device 100 when the display device 100is turned on. The storage unit 160 may be a ROM, a RAM or a memory card(e.g., an SD card or a memory stick) detachably mountable to the displaydevice 100, a nonvolatile memory, a volatile memory, a hard disk drive(HDD) or a solid state drive (SSD).

As illustrated in FIG. 3, the display device 100 may further include areceiver 170, a signal processor 180, and an audio output unit 190.

The receiver 170 may include an IR receiver (not shown) receiving a usercommand transmitted from a remote control device (not shown) forcontrolling the operation of the display device 100. Specifically, theremote control device (not shown) may transmit a user command, such as afunction setting of the display device 100, to the display device 100through a control signal such as an IR signal or an RF signal.Accordingly, the receiver 170 can receive a user command such as afunction setting of the display device 100 based on a control signalreceived through a remote control device (not shown) through an IRreceiver (not shown). In addition, the receiver 170 may include a tunerunit (not shown) for receiving a broadcast signal of a broadcast channelselected by a user from a plurality of image contents provided from abroadcast server (not shown). In this case, when the channel tuningcommand is inputted through the remote control unit (not shown), thereceiver 170 may tune a channel corresponding to the channel selectioncommand received from the remote control unit (not shown) through thetuner unit and receive the broadcast signal through the tuned channel.

The signal processing unit 180 processes the data received from theterminal device including the plurality of peripheral devices 200through a broadcast signal of the broadcast channel received through thereceiver 170 or the communication unit 110. In addition, the signalprocessing unit 180 may process the application-related contentsexecuted in accordance with the user's command in a displayable formthrough the display 120.

The audio output unit 190 may output signal-processed audio data viaspeaker through the signal processing unit 180, and the display 120 maydisplay the signal-processed video data on a screen through the signalprocessing unit 180.

As described above, when the peripheral device 200 adjacent to thedisplay device 100 is detected through the sensor 140, or the peripheraldevice 200 corresponding to the user command input through the inputunit 150 is selected, the control unit 130 can extract sourceinformation related to an area to be transmitted to the peripheraldevice 200 among a plurality of areas constituting an execution screenof the application, based on the following embodiment. Here, the sourceinformation may include at least one of an execution code and a resourcefor execution of an area to be transmitted to the peripheral device 200among a plurality of areas constituting an execution screen of theapplication.

When the peripheral device 200 adjacent to the display device 100 isdetected or selected, the control unit 130 may extract predeterminedsource information relating to an area to be transmitted to theperipheral device 200 from among a plurality of areas constituting anexecution screen of an application.

According to another embodiment, when the peripheral device 200 adjacentto the display device 100 is detected or selected, the control unit 130may analyze an execution code for executing an area to be transmitted tothe peripheral device 200, from among a plurality of areas constitutingan execution screen of an application, and extract source informationrelating to the area.

FIGS. 4A and 4B are exemplary diagrams which extract source informationrelating to an area to be transmitted to a peripheral device from amonga plurality of areas constituting an execution screen of an applicationaccording to an exemplary embodiment.

As shown in FIG. 4A, the display device 100 may display an executionscreen 410 of an application divided into a plurality of areas accordingto a user command. The execution screen 410 of such an application canbe divided into a plurality of areas, and each area has a hierarchicalstructure as shown in FIG. 4B. Specifically, each of the plurality ofareas constituting the application execution screen 410 may behierarchically configured with an execution code for executing each areaand a resource associated with each execution code.

For example, as shown in FIG. 4A, the first area 411 of the plurality ofareas constituting the application execution screen 410 may be locatedadjacent to the display device 100, or may be determined as an area tobe executed in the selected peripheral device 200 according to a usercommand.

In this case, as shown in FIG. 4B, the control unit 130 performsstatic/dynamic analysis with respect to an execution code correspondingto the first area 411, from among a plurality of areas, from anexecution program to execute the execution screen 420 of theapplication.

If the resource related to the execution code corresponding to the firstregion 411 is extracted based on the analyzed result, the control unit130 may analyze the first area 411, an execution code corresponding tothe first area 411, and a relationship with the resource extracted fromthe execution code, to extract source information 411′ relating to thefirst area 411.

When the source information 411′ for the first area 411 is extracted,the control unit 130 transmits the source information 411′ extracted inrelation to the first area 411 to the peripheral device 200.Accordingly, the peripheral device 200 can display the information ofthe first area 411 based on the source information 411′ received fromthe display device 100.

The control unit 130 may determine an area to be transmitted to at leastone peripheral device 200 from among a plurality of areas constitutingan execution screen of an application based on the exemplary embodimentas shown below.

If the peripheral device 200 is detected to be proximate to the displaydevice 100 through the at least one sensor 140, the control unit 130 maydetect a position where the peripheral device 200 is proximate based onsensing information sensed from at least one sensor 140.

The control unit 130 then extracts the source information of the firstarea related to the position where the peripheral device 200 is adjacentto the plurality of areas constituting the application execution screenand controls the communication unit 110 to transmit the sourceinformation to the peripheral device 200 adjacent to the display device100. Accordingly, the communication unit 110 transmits the sourceinformation of the first area to the peripheral device 200 adjacent tothe display device 100. The peripheral device 200 can generate anexecution screen or information related to the first area based on thesource information received from the display device 100 and display iton the screen.

According to another embodiment, when the peripheral device 200 isdetected as being proximate to the display device 100 through the atleast one sensor 140, the control unit 130 may request to the peripheraldevice 200 which is proximate to the display device 100 based on thedetection information sensed through the at least one sensor 140.Accordingly, when the device information is received from the peripheraldevice 200 adjacent to the display device 100, the control unit 130controls the plurality of areas constituting the execution screen of theapplication based on the acquired device information of the peripheraldevice 200 and extract source information of the first area executableby the peripheral device 200 adjacent to the display device 100. Here,the device information may be specification information for dataprocessing in the peripheral device 200.

The control unit 130 then controls the communication unit 110 totransmit the extracted source information to the peripheral device 200adjacent to the display device 100.

Accordingly, the communication unit 110 transmits the source informationof the first area to the peripheral device 200 adjacent to the displaydevice 100. Accordingly, the peripheral device 200 can generate anexecution screen or information related to the first area based on thesource information received from the display device 100 and display iton the screen.

According to another embodiment, when the peripheral device 200 isdetected as being proximate to the display device 100 through the atleast one sensor 140, the control unit 130 may transmit the deviceinformation to the peripheral device 200 which is adjacent to thedisplay device 100 based on sensing information sensed through at leastone sensor 140.

Accordingly, when the device information is received from the peripheraldevice 200 adjacent to the display device 100, the control unit 130extracts the source information of the first area executable in theperipheral device 200 adjacent to the display device 100 based on thedevice information of the peripheral device 200 and information of theplurality of areas constituting the execution of the application. Here,the device information may be specification information for dataprocessing in the peripheral device 200.

The control unit 130 then controls the communication unit 110 totransmit the extracted source information to the peripheral device 200adjacent to the display device 100.

Accordingly, the communication unit 110 transmits the source informationof the first area to the peripheral device 200 adjacent to the displaydevice 100. Accordingly, the peripheral device 200 can generate anexecution screen or information related to the first area based on thesource information received from the display device 100 and display iton the screen.

According to another embodiment, the control unit 130 may analyze aplurality of areas constituting an execution screen of an applicationbeing executed and, based on the analysis result and the deviceinformation of the peripheral device 200 adjacent to the display device100, may extract and transmit the source information of at least onearea to the peripheral device 200 corresponding to the predeterminedcondition.

To be specific, if the first area of the plurality of areas constitutingthe execution screen of the application is an area for receiving a usercommand or an area for displaying user information, the control unit 130may determine the first peripheral device 200-1 corresponding to thepreset first condition as the device to which the source information ofthe first area is to be transmitted. For example, the first area amongthe plurality of areas constituting the execution screen of theapplication may be an area for receiving a simple user command of theuser or displaying the personal information of the user. In this case,the control unit 130 controls the first peripheral device 200-1 of thesmall terminal such as the smart watch or the first peripheral device200-1 of the peripheral device 200, which is adjacent to the displaydevice 100, as the device to which the source information is to betransmitted.

As such, when the device to which the source information of the firstarea is to be transmitted is determined, the control unit 130 extractsthe source information of the first area and transmits the extractedsource information to the first peripheral device 200-1 and controls thecommunication unit 110 to transmit the data. Accordingly, thecommunication unit 110 transmits the source information of the firstarea to the first peripheral device 200-1 adjacent to the display device100. Accordingly, the first peripheral device 20-10 may receive a usercommand related to the first area based on the source informationreceived from the display device 100, or may generate and display a UIscreen for providing user information.

On the other hand, if the second area of the plurality of areasconstituting the application execution screen is an area for displayingcontents, the control unit 130 controls the display unit 100 to displaya content corresponding to a predetermined second condition among theperipheral devices 200 adjacent to the display device 100. The secondperipheral device 200-2 can be determined as a device to transmit thesource information of the second area. For example, the second areaamong the plurality of areas constituting the execution screen of theapplication may be an area for providing contents with a large amount ofinformation. In this case, the control unit 130 can determine the secondperipheral device 200-2 having a high specification for data processingamong the peripheral devices 200 adjacent to the display device 100 asthe device to transmit the source information of the second area.

As described above, when a device to transmit the source information ofthe second area is determined, the control unit 130 extracts the sourceinformation of the second area and transmits the extracted sourceinformation of the second area to the second peripheral device 200-2 andcontrols the communication unit 110 to transmit the data. Accordingly,the communication unit 110 transmits the source information of thesecond area to the second peripheral device 200-2 adjacent to thedisplay device 100. Accordingly, the second peripheral device 20-10 cangenerate and display a content UI screen related to the second areabased on the source information received from the display device 100.

According to another embodiment, the control unit 130 may generate atleast one of the plurality of areas constituting the execution screen ofthe application, based on the user command inputted through the inputunit 150. Here, the user command may include a first user command forone of a plurality of areas constituting an execution screen of anexecuting application, a second user command for a device to transmitsource information of the selected area based on the first user command.

That is, when the first user command is inputted through the input unit150, the control unit 130 extracts source information related to thefirst region corresponding to the first user command among the pluralityof regions constituting the execution screen of the application. If thesecond user command is input through the input unit 150, the controlunit 130 determines whether the first peripheral device 200corresponding to the second user command among the plurality ofperipheral devices 200 capable of communicating with the display device100-1 to control the communication unit 110 to transmit the extractedsource information in association with the first area. Accordingly, thecommunication unit 110 transmits the source information of the firstarea to the first peripheral device 200-1 corresponding to the commandof the second user.

Therefore, the first peripheral device 200-1 may generate an executionscreen or information relating to the first area based on sourceinformation received from the display device 100 and display on ascreen.

In the present invention, description has been made on the case wherethe source information of the area corresponding to the first usercommand is extracted, and then the second user command for theperipheral device 200 to transmit the extracted source information isinputted. However, the input unit 150 can simultaneously receive thefirst and second user commands.

When the source information related to at least one of the plurality ofareas constituting the execution screen of the application beingexecuted is transmitted to at least one peripheral device 200, theexecution screen of the application can be edited based on the remainingarea excluding the area related to the source information, and theedited execution screen can be displayed.

For example, the application execution screen is divided into first tothird areas, and the source information related to the first one of thefirst to third areas is transmitted to the peripheral device 200adjacent to the display device 100. In this case, the control unit 130can reconstruct and display an execution screen for the applicationbased on the second and third areas except for the first area of thefirst to third areas.

Meanwhile, if it is detected that the execution screen return command isinput or the peripheral device 200, to which the source information istransmitted, is not adjacent to the periphery of the display device 100,the control unit 130 may re-edit and display an execution screen of theedited application as an initial execution screen.

When an event for transmitting the source information related to thechanged area to the peripheral device 200 occurs, the control unit 130may re-edit the edited execution based on the remaining area excludingthe changed area among the plurality of areas constituting the executionscreen of the application and display the re-edited execution screenthrough the display 120.

For example, the peripheral device 200 adjacent to one side of thedisplay device 100 may receive source information related to the firstone of a plurality of areas constituting an execution screen of theapplication from the display device 100. The peripheral device 200receiving the source information may move from one side to the otherside of the display device 100 and cause a nearby event to occur. Assuch, when the peripheral device 200 is detected as being adjacent tothe other side of the display device 100, the control unit 130determines the position of the peripheral device 200 adjacent to theother side of the display device 100, extracts the source information ofthe second area related to the determined position, and transmits theextracted source information to the peripheral device 200.

Thereafter, the control unit 130 re-edits the execution screen editedbased on the remaining area excluding the second area among theplurality of areas constituting the execution screen of the application,and displays the execution screen re-edited through the display 120.

The peripheral device 200, which receives the source information relatedto the specific area among the plurality of areas constituting theexecution screen of the application through the above-described variousembodiments, may display information related to some of the areas of thedisplay area. When the user command for application control is input inthe state that the information is displayed, the peripheral device 200transmits the inputted user command to the display device 100.Accordingly, the control unit 130 can control the operation of theapplication being executed based on the user command received from theperipheral device 200.

So far, various configurations of the display device 100 for providingthe multi-UI service to the peripheral device 200 according to thepresent invention have been described in detail. Hereinafter, an area tobe transmitted to the peripheral device 200 among a plurality of areasconstituting an execution screen of an application in the display device100 is determined, and an operation of executing the determined area inthe peripheral device 200 will be described in detail.

FIG. 5 is an exemplary diagram illustrating an execution screen of adisplay device according to an exemplary embodiment.

As shown in FIG. 5, the display device 100 may execute a selectedapplication according to a user command and display an execution screen510 of the executed application. As described above, the applicationexecution screen 510 can be divided into a plurality of areas.Therefore, the display device 100 can display the application executionscreen 510 by executing the respective areas based on at least one ofthe execution codes and resources for each area constituting theexecution screen 410 of the application.

Specifically, the application execution screen 510 can be divided intofirst to third areas 511 to 515. In this case, the display device 100may, based on an execution code corresponding to each of the first tothird areas 511-515 constituting the execution screen 510 of theapplication and resources relating to each execution code, execute thefirst to third areas 511-515 and display the execution screen 410 of theapplication from the combination of the executed first to third areas511-513.

FIG. 6 is a first exemplary diagram performing a multi UI servicebetween a display device and a peripheral device according to anexemplary embodiment.

As illustrated in FIG. 5, the display device 100 may display anexecution screen 510 of an application constituting of the first tothird areas 511 to 515. Meanwhile, the peripheral device 200 may beadjacent to one side of the display device 100 displaying the executionscreen 510 of the application.

As such, when the peripheral device 200 approaches to one side, thedisplay device 100, based on the aforementioned various exemplaryembodiments, may determine the second area 513 from among the first tothird areas 511-515 constituting the execution screen 510 of theapplication as an area to be executed in the peripheral device 200. Thedisplay device 100 then extracts the source information of the secondarea 513 determined as an area to be executed by the peripheral device200 close to one side of the display device 100 and transmits theextracted source information to the peripheral device 200 close to thedisplay device 200. The peripheral device 200 adjacent to the displaydevice 100 generates a UI screen 620 relating to the second area 510from among the first to third areas 511-515 constituting the executionscreen 510 of the application based on the source information receivedfrom the display device 100 and displays on the screen.

On the other hand, the display device 100, which has transmitted thesource information related to the second area 513 to the peripheraldevice 200, may edit the execution screen 510 of the application basedon source information of the remaining area excluding the second area513 from among the first to third areas 511-515, that is, the first andthird areas 511 and 515 and display the edited execution screen 610.

FIG. 7 is a second exemplary diagram performing a multi UI servicebetween a display device and a peripheral device according to anexemplary embodiment.

As illustrated in FIG. 6, the peripheral device 200 adjacent to one sideof the display device 100 may generate and display an UI screen 620relating to the second area 513 based on the source information of thesecond area 513 received from the display device 100. In this way, theperipheral device 200, which is positioned on one side of the displaydevice 100 and displays the UI screen 620 related to the second area513, can move to the other side of the display device 100.

As shown in FIG. 7, the peripheral device 200 located adjacent to theleft side of the display device 100 may be positioned close to the upperside of the display device 100. As such, if the peripheral device 200located close to the left side of the display device 100 is detected asbeing close to the upper side of the display device 100, the displaydevice 100 can display, based on the various exemplary embodiments, maydetermine the first area 511 of the first to third areas 511 to 515constituting the execution screen 510 as an area to be executed in theperipheral device 200 adjacent to the upper side of the display device100. Then the display device 100 extracts source information of thefirst area 511 which is determined as an area to be executed in theperipheral device 200 adjacent to the upper side of the display device100, and transmits the extracted source information to the peripheraldevice 200 adjacent to the upper side of the display device 100.Accordingly, the peripheral device 200 which is adjacent to the upperside of the display device 100 generates and displays a UI screen 720relating to the first area 511 from among the first to third areas511-515 constituting the execution screen 510 based on the sourceinformation received from the display device 100.

On the other hand, as described above, the display device 100 which isdisplaying the execution screen 610 of the edited application based onsource information of the first and third areas 511, 515 excluding thesecond area 13 from among the first to third areas 511-515 constitutingthe execution screen 510 of the application, when source informationrelating to the first area 511 is transmitted to the peripheral device200, may edit the execution screen 510 of the application based on thesource information of the remaining second and third areas 513, 515excluding the first area 511 from among the first to third areas 511-515constituting the execution screen 510 of the application and display theedited execution screen 710.

Hereinafter, an operation of determining an area to be transmitted to aplurality of peripheral devices 200 among a plurality of areasconstituting an execution screen of an application in the display device100 and executing the determined area in a plurality of peripheraldevices 200 will be described in a greater detail.

FIG. 8A is a first exemplary diagram of performing a multi UI servicebetween a display device and a plurality of peripheral devices accordingto an exemplary embodiment.

As illustrated in FIG. 5, the display device 100 may display anexecution screen 510 of an application configured by the first to thirdareas 511 to 515. Meanwhile, the first peripheral device 200-1 among theplurality of peripheral devices 200 that can communicate with each othermay be close to the upper side of the display device 100 that displaysthe application execution screen 510. The display device 200-2 may beclose to the left side of the display device 100 displaying theexecution screen 510 of the application.

As described above, when the first and second peripheral devices 200-1and 200-2 approach the upper side and the left side of the displaydevice 100, the display device 100 can determine the first area 511 fromamong the first to third areas 511-515 constituting the execution screen510 to be an area to be executed in the first peripheral device 200-1adjacent to the upper side of the display device 100, and determinesecond area 513 as an area to be executed in the second peripheraldevice 200-2 adjacent to the left side of the display device 100.

As described above, when an area to be executed by each of the first andsecond peripheral devices 200-1 and 200-2 close to the display device100 is determined, the display device 100 extracts source information ofthe first and second areas 511, 513 determined as an area to be executedin the first and second peripheral devices 200-1 and 200-2 adjacent tothe display device 100. Then, the display device 100 transmits thesource information of the first area to the first peripheral device200-1 adjacent to the upper side, and transmits the source informationof the second area to the second peripheral device 200-2 adjacent to theleft side of the display device 100.

Accordingly, the first peripheral device 200-1 close to the upper sideof the display device generates a UI screen 820 related to the firstarea 511 from among the first to third areas 511-515 constituting theexecution screen 510 of the application based on the source informationreceived from the display device 100 and displays the UI screen on ascreen. In addition, the second peripheral device 200-2 adjacent to aleft side of the display device 100, based on the source informationreceived from the display device 100, generates a UI screen 830 relatingto the second area 513 from among the first to third areas 511-515constituting the execution screen 510 of the application and displays onthe screen.

On the other hand, the display device 100, which has transmitted thesource information related to the first and second areas 511 and 513 tothe first and second peripheral devices 200-1 and 200-2, may edit theexecution screen 510 of the application based on the source informationof the third area 515, which is the remaining area excluding the firstand second areas 511, 513 from among the first to third areas 511-515and display the edited execution screen 810.

FIG. 8B is a first exemplary diagram of performing an operationcorresponding to an event by a plurality of peripheral devicesperforming a multi UI service with the display device according to anexemplary embodiment.

As illustrated in FIG. 8A, the first peripheral device 200-1 close tothe upper side of the display device generates a UI screen 820 relatedto the first area 511 based on the source information received from thedisplay device 100 and displays the UI screen. In addition, the secondperipheral device 200-2 adjacent to a left side of the display device100 may display the UI screen 830 relating to the second area 513 basedon the source information received from the display device 100.

As illustrated in FIG. 8B, when the first peripheral device 200-1displaying the UI screen 820 related to the first area 511, if a screenswitching even occurs according to a user manipulation, may rotate theUI screen 820 in a direction corresponding to the screen switching eventand display the rotated UI screen 820′.

That is, the first peripheral device 200-1 located in the verticaldirection (horizontal direction) with respect to the center axis of thefirst peripheral device 200-1 can be located in a horizontal direction(length direction) according to a user manipulation. In this case, thefirst peripheral device 200-1 can switch the UI screen 820 generated inthe horizontal direction to the UI screen 820′ corresponding to thevertical direction and display the UI screen 820′.

FIG. 8C is a second exemplary diagram of performing an operationcorresponding to an event by a plurality of peripheral devicesperforming a multi UI service with the display device according to anexemplary embodiment.

As illustrated in FIG. 8A, the first peripheral device 200-1 close tothe upper side of the display device generates a UI screen 820 relatedto the first area 511 based on the source information received from thedisplay device 100 and displays the UI screen. In addition, the secondperipheral device 200-2 adjacent to a left side of the display device100 may display the UI screen 830 relating to the second area 513 basedon the source information received from the display device 100.

As illustrated in FIG. 8C, the second peripheral device 200-2, whichdisplays the UI screen 830 related to the second area 513, when an eventto receive a message through social network services (SNS) occurs, mayswitch the currently-display UI screen 830 to a community UI screen 840for providing a social network service and display the screen.

However, the present invention is not limited to thereto, and the secondperipheral device 200-2, which displays the UI screen 830 related to thesecond area 513, when an event to receive a message through SNS occurs,may overlap and display the community UI screen 840 for providing asocial network service on the displayed UI screen 830.

However, the present invention is not limited to thereto, and the secondperipheral device 200-2, which displays the UI screen 830 related to thesecond area 513, when an event to receive a message through SNS occurs,may display the UI screen 830 relating to the second area 513 andprovide a notification service indicating that a message is received.

FIGS. 9A and 9B are a second exemplary diagram of performing a multi UIservice between a display device and a plurality of peripheral devicesaccording to an exemplary embodiment according to an exemplaryembodiment.

As illustrated in FIG. 9A, the display device 100 can execute a cardgame related application according to a user command, display anexecution screen 910 for the executed application. Around the displaydevice 100, there may be first to fourth peripheral devices 200-1 to200-4.

On the other hand, the display device 100, while the execution screen910 regarding a card game application is displayed, may receive aselection command to each object 911-917 included in the executionscreen 910 and a selection command to the peripheral devices 200-1 to200-4 on which the UI screen corresponding to each object is to bedisplayed.

Specifically, from among the plurality of objects 911-917 included inthe execution screen 910 with respect to the card game application, auser command with respect to the first object 911 and the firstperipheral device 200-1 to provide a UI service relating to the firstobject 911 is input, the display device 100, based on the input usercommand, extracts source information of the first area relating to thefirst object 911 and transmits the information to the first peripheraldevice 200-1. When a user command with respect to the second object 913and a second peripheral device 200-2 to provide a UI service relating tothe second object is input, the display device 100, based on the inputuser command, extracts source information of the second area relating tothe second object 913 and transmits the information to the secondperipheral device 200-2.

When a user command with respect to the third object 915 and a thirdperipheral device 200-3 to provide a UI service relating to the thirdobject is input, the display device 100, based on the input usercommand, extracts source information of the third area relating to thethird object 915 and transmits the information to the third peripheraldevice 200-3. Finally, when a user command with respect to the fourthobject 917 and a fourth peripheral device 200-4 to provide a UI servicerelating to the fourth object is input, the display device 100, based onthe input user command, extracts source information of the third arearelating to the fourth object 917 and transmits the information to thefourth peripheral device 200-4.

However, the present invention is not limited thereto, and the displaydevice 100 may determine an object to be transmitted to the first tofourth peripheral devices 200-1-200-4 from among the plurality ofobjects 911-917 based on each position of the first to the fourthperipheral devices 200-1 to 100-4 adjacent to the display device 100.

For example, the first and fourth peripheral devices 200-1 and 200-4 maybe close to the upper and lower sides of the display device 100, and thesecond and third peripheral devices 200-2 and 200-3 may adjacent to theleft side and right side of the display device 100. In this case, thedisplay device 100 may, considering the adjacent position of the firstto fourth peripheral devices 200-1, 200-2, may extract and transmitsource information of the first and fourth areas relating to the firstand fourth objects 911, 917 to the first and fourth peripheral devices200-1, 200-4 adjacent to an upper side and a lower side. The displaydevice 100 may extract and transmit source information of the second andthird areas relating to the second and third objects 913, 917 to thesecond and third peripheral devices 200-2 and 200-3 adjacent to the leftside and right side.

Thus, as shown in FIG. 9B, the first and second peripheral devices 200-1and 200-2 can display the UI screens 911′ and 913′ corresponding to thefirst and second objects 911, 913 based on the source informationreceived from the display device 100. The third and fourth peripheraldevices 200-3 and 200-4 may display UI screens 915′ and 917corresponding to the third and fourth objects 915 and 917, respectively,based on the source information received from the display device 100.

On the other hand, the display device 100, which has transmitted thesource information for each of the first to fourth objects 911 to 917 tothe first to fourth peripheral devices 200-1 to 200-4, may edit anexecution screen 910 regarding an application based on the fifth areaexcluding the first to fourth objects 911-917 relating to the first tofourth areas from among the first to fifth areas constituting theexecution screen 910 and display the edited execution screen 920.

Based on the source information received from the display device 100,when a user command relating to the UI screen 911′ is received from thefirst peripheral device 200-1 from among the first to fourth peripheraldevices 200-1 to 200-4 displaying the UI screens 911′-917 correspondingto the first to fourth objects 911-917, the input user command istransmitted to the display device 100. When a user command is receivedfrom the first peripheral device 200-1, the display device 100 mayre-edit and display the displayed execution screen 920 based on thereceived user command.

FIG. 10 is a third exemplary diagram of performing a multi UI servicebetween a display device and a plurality of peripheral devices accordingto an exemplary embodiment according to an exemplary embodiment.

As shown in FIG. 10, the display device 100 may display a content listUI 1010 including a thumbnail image for identifying each of a pluralityof contents on a screen. In the state where the content list UI 1010 isdisplayed, the display device 100 may transmit the content sourceinformation corresponding to the thumbnail image included in the contentlist UI 1010 to at least one peripheral device 200 among a plurality ofperipheral devices 200 capable of communicating based on a user command.

As illustrated, the content list UI 1010 displayed on the screen of thedisplay device 100 may include A to H thumbnail images and theperipheral device 200 capable of communicating with the display device100 may be a Smart TV, vehicle-mounted navigation and a notebook. On theother hand, the user may request that the content corresponding to the Athumbnail image from the content list UI 1010 displayed on the screen ofthe display device 100 is displayed on the smart TV as the firstperipheral device 200-1, and the content corresponding to the Bthumbnail image is displayed on a navigation which is the secondperipheral device 200-2, and the content corresponding to the Cthumbnail image is displayed in a notebook, which is the third device200-3.

In response to the request, the display device 100 extracts sourceinformation related to the A thumbnail image among the plurality ofthumbnail images included in the content list U1 1010 displayed on thescreen and transmits to the first peripheral device 200-1, extractssource information related to B thumbnail image and transmits to thesecond peripheral device 200-2, and extracts source information relatedto the C thumbnail image and transmits to the third peripheral device200-3.

Accordingly, the smart TV as the first peripheral device 200-1 displaysthe A content 1020 related to the A thumbnail image based on the sourceinformation received from the display device 100, and the secondperipheral device 200-2 can display B content 1030 related to the Bthumbnail image based on the source information received from thedisplay device 100.

The notebook, which is the third peripheral device 200-2, can displaythe C content 1040 related to the C thumbnail image on the screen basedon the source information received from the display device 100.

FIG. 11 is a fourth exemplary diagram of performing a multi UI servicebetween a display device and a plurality of peripheral devices accordingto an exemplary embodiment according to an exemplary embodiment.

As illustrated in FIG. 11, the display device 100 can display anexecution screen 1110 of an application in the form of a tab view, and aplurality of areas constituting an execution screen 1110 of anapplication may include the first to third areas 1111-1115 fordisplaying A to C tabs and the fourth area 1117 for displaying aselected tab among A to C tabs.

As illustrated, the display device 100 for displaying the executionscreen 1110 of the application of the tab view type, when a selectioncommand for the step A among the A to C tabs is inputted, may display Acontent relating to A tab on the fourth area 1117.

Meanwhile, the user may request that the b content 1120 relating to Btab is displayed on the first peripheral device 200-1 adjacent to thedisplay device 100 from the execution screen 1110 of the application ina tab view format displayed on a screen of the display device 100 anddisplay C content 1130 relating to C tab on the second peripheral device200-2.

In response to such request, the display device 100 extracts the sourceinformation associated with the second area 1113 displaying the B taband transmits the information to the first peripheral device 200-1, andextracts the source information related to the third area 1115displaying C tab, and transmits the extracted source information to thesecond peripheral device 200-2.

Accordingly, the first peripheral device 200-1 can display, on thescreen, the b content 1120 to be executed at the time of the selectioncommand for the B tab, based on the source information received from thedisplay device 100. The second peripheral device 200-2 can display onthe screen the c content 1130 to be executed at the time of a selectioncommand for the C tab based on the source information received from thedisplay device 100.

FIG. 12 is a fourth exemplary diagram of performing a multi UI servicebetween a display device and a plurality of peripheral devices accordingto an exemplary embodiment according to an exemplary embodiment.

As illustrated in FIG. 12, according to an exemplary embodiment, thedisplay device 100 and the peripheral device 200 mounted on the homeappliance such as the smart TV 10, the smart refrigerator 20, and thesmart air conditioner 30 may be connected to each other, when theperipheral device 200 approaches within a predetermined thresholddistance, and may transmit source information relating to control UI forcontrolling the operation of the display device 100 to the peripheraldevice 200.

More specifically, when the display device 100 mounted in the smart TV10 detects that the peripheral device 200 is within a predeterminedthreshold distance, the display device 100 extracts source informationfor controlling the TV function of the smart TV 10, and transmits theextracted source information to the peripheral device 200. Accordingly,the peripheral device 200) can generate a control UI 1210 forcontrolling the TV function of the smart TV 10 based on the sourceinformation received from the smart TV 10, and display the control UI1210 on the screen.

The display device 100 mounted in the smart refrigerator 20 extractssource information for controlling the refrigeration function of thesmart refrigerator 20 when it is detected that the peripheral device 200is within a predetermined threshold distance, and transmits theextracted source information to the peripheral device 200. Accordingly,the peripheral device 200 can generate the control UI 1220 forcontrolling the refrigeration function of the smart refrigerator 20based on the source information received from the smart refrigerator 20,and display the control UI 1220 on the screen.

The display device 100 installed in the smart air conditioner 30extracts source information for controlling the air conditioner functionof the smart air conditioner 30 when the peripheral device 200 isdetected to be within a predetermined threshold distance, and transmitsthe extracted source information to the peripheral device 200.Accordingly, the peripheral device 200 can generate and display acontrol UI 1230 for controlling the air conditioner function of thesmart air conditioner 30 based on the source information received fromthe smart air conditioner 30.

According to another embodiment, the peripheral device 200 may beinstalled in each of the smart TV 10, the smart refrigerator 20 and thesmart air conditioner 30 to execute an execution program of the displaydevice 100 for controlling the operation of each home appliance, andsuch an executable program may be periodically updated and stored in theperipheral device 200.

Accordingly, if it is determined that the peripheral device 200 islocated within a predetermined threshold distance from at least one ofthe smart TV 10, the smart refrigerator 20, and the smart airconditioner 30, and is connected to the display device 100 mounted onthe home appliance, the peripheral device 200 may transmit the sourceinformation related to the updated execution program to the displaydevice 100 mounted in the nearby home appliance. Therefore, the displaydevice 100 mounted in the home appliance such as the smart TV 10, thesmart refrigerator 20 and the smart air conditioner 30 update apre-installed execution program to the latest version on the basis ofthe source information received from the peripheral device 200.

Hereinafter, a method for controlling an operation of the display device100 which performs a multi UI service with at least one peripheraldevice 200 according to the present invention will be described indetail.

FIG. 13 is a first flowchart of a controlling method of a display deviceaccording to an exemplary embodiment.

As illustrated in FIG. 13, the display device 100 displays an executionscreen of an application requested by a user according to a user command(S1310). Here, the application execution screen may be a UI screendivided into a plurality of areas.

When the execution screen of the application divided into the pluralityof areas is displayed, the display device 100 extracts the sourceinformation related to the area to be transmitted to the peripheraldevice among the plurality of areas constituting the execution screen ofthe application (S1320). Here, the source information may include atleast one of an execution code and a resource for execution of an areato be transmitted to the peripheral device 200 among a plurality ofareas constituting an execution screen of the application.

When the source information is extracted, the display device 100transmits the extracted source information to the peripheral device 200(S1330). Accordingly, the peripheral device 200 can display informationon an area related to the received source information among a pluralityof areas constituting an execution screen of the application, based onthe source information received from the display device 100.

According to one embodiment, when at least one of the plurality ofperipheral devices 200 is adjacent to the display device 100, thedisplay device 100 determines the position of the adjacent peripheraldevice 200. Then, the display device 100 extracts the source informationof the first area related to the position of the peripheral device 200among the plurality of areas constituting the execution screen of theapplication, and displays the source information of the extracted firstarea on the display device 100 to the adjacent peripheral device 200.Accordingly, the peripheral device 200 can display information relatedto the first area based on the source information received from thedisplay device 100.

According to another embodiment, when at least one peripheral device 200of a plurality of peripheral devices 200 is adjacent to the displaydevice 100, the display device 100 displays the peripheral device 200 onthe basis of the device information of the peripheral device 200.

The device may extract the source information of the first area that canbe executed in the peripheral device 200 and transmit the extractedsource information to the peripheral device 200. Accordingly, theperipheral device 200 can display information related to the first areabased on the source information received from the display device 100.

According to still another embodiment, when at least one of theperipheral devices 200 of the plurality of peripheral devices 200 isadjacent to the display device 100, based on the device information ofthe adjacent peripheral device 200 and execution information of each ofthe plurality of peripheral devices 200, the display device 100 extractsthe source information of the executable area in the peripheral device200 adjacent to the display device 100 based on the information. Then,the display device 100 can transmit the extracted source information tothe peripheral device 200 adjacent to the display device 100.

At this time, if the first area of the plurality of areas constitutingthe execution screen of the application receives the user command orreceives the user information, the display device 100 may transmit thesource information of the first area to the first peripheral device200-1 corresponding to the preset first condition.

Meanwhile, if the second area among the plurality of areas constitutingthe application execution screen is an area for displaying contents, thedisplay device 100 may transmit source information of the second area tothe second peripheral device 200-2 corresponding to a preset secondcondition from among the peripheral device 200 adjacent to the displaydevice 100.

According to still another embodiment, the display device 100 canextract source information of a first area corresponding to a usercommand among a plurality of areas constituting an execution screen ofan application. When the source information of the first area isextracted, the display device 100 can transmit the source information ofthe first area to the peripheral device 200 corresponding to the usercommand among the communicable peripheral devices 200.

Meanwhile, the display device 100 determines whether a user command isreceived from the peripheral device 200 that has transmitted theextracted source information through the above-described variousembodiments (S1340). As a result of the determination, when a usercommand is received from the peripheral device 200 that has transmittedthe source information, the display device 100 controls the operation ofthe application being executed based on the user command received fromthe peripheral device 200 (S1350).

To be specific, the peripheral device 200 which receives sourceinformation relating to a specific area from among a plurality of areasconstituting an execution screen of an application may displayinformation relating to a part of an area from among a plurality ofareas constituting an execution screen of an application based on thereceived source information. While the information is displayed, when auser command for controlling an application is input, the peripheraldevice 200 transmits the input user command to the display device 100.Accordingly, the display device 100 may control an operation of anoperating application based on the user command received from theperipheral device 200.

FIG. 14 is a second flowchart of a controlling method of a displaydevice according to still another exemplary embodiment.

As shown in FIG. 14, the display device 100 displays an execution screenof an application divided into a plurality of areas (S1410). When theexecution screen of the application divided into the plurality of areasis displayed, the display device 100 extracts the source informationrelated to the area to be transmitted to the peripheral device among theplurality of areas constituting the execution screen of the application(S1420). When the source information is extracted, the display device100 transmits the extracted source information to the peripheral device200 (S1430). Accordingly, the peripheral device 200 can displayinformation on an area related to the received source information amonga plurality of areas constituting an execution screen of theapplication, based on the source information received from the displaydevice 100.

The operations of steps S1410 to S1430 described above are the same asthose of steps S1310 to S1330 of FIG. 13 described above. Therefore,detailed description of the operation of steps S1410 to S1430 will beomitted below.

On the other hand, when the source information extracted in step S1430is transmitted to the peripheral device 200, the display device 100edits an execution screen of an application based on a remaining areaexcluding an area relating to source information transmitted to theperipheral device from among a plurality of areas constituting theexecution screen of the application and display the execution screen ofthe edited application (S1440).

For example, the application execution screen is divided into first tothird areas, and the source information related to the first one of thefirst to third areas is transmitted to the peripheral device 200adjacent to the display device 100. In this case, the display device 100can reconstruct and display an execution screen for the applicationbased on the second and third areas except for the first area of thefirst to third areas.

Meanwhile, when an execution screen return command is input or an eventis detected in which the peripheral device 200 transmitting the sourceinformation is not close, the display device 100 may re-edit and displaythe edited execution screen as an initial execution screen of theapplication.

When an event for transmitting source information related to an areachanged to the peripheral device 200 occurs, the display device 100 mayre-edit the edited execution screen based on the remaining area exceptfor the changed area among the plurality of areas, and display theexecution screen of the re-edited application.

The foregoing exemplary embodiments and advantages are merely exemplaryand are not to be construed as limiting the inventive concept. Theexemplary embodiments may be readily applied to other types of device orapparatus. Also, the description of the exemplary embodiments isintended to be illustrative, and not to limit the scope of the inventiveconcept, and many alternatives, modifications, and variations will beapparent to those skilled in the art.

What is claimed is: 1: A method for controlling a display devicecomprising: displaying an execution screen of an application which isdivided into a plurality of regions; extracting source informationrelated to a first region, from among the plurality of regions, to betransmitted to a first peripheral device; editing the execution screenbased on a region other than the first region; transmitting theextracted source information to the first peripheral device; and basedon transmitting extracted source information to the first peripheraldevice, displaying the edited execution screen. 2: The method of claim1, wherein the first region is identified based on a position of thefirst peripheral device. 3: The method of claim 1, wherein the firstregion is identified based on device information of the first peripheraldevice. 4: The method of claim 1, wherein the first region is identifiedbased on device information of the first peripheral device and executioninformation of the plurality of regions. 5: The method of claim 4,wherein the first region is a region for receiving a user command or fordisplaying user information, and the method further comprises extractingthe source information for a second region, from among the plurality ofregions, for displaying content and transmitting the extracted sourceinformation for the second region to a second peripheral devicedifferent from the first peripheral device. 6: The method of claim 1,wherein the first region corresponds to a region for receiving a usercommand. 7: The method of claim 1, further comprising, when an executionscreen return command is input or an event is detected in which theperipheral device transmitting the source information is not close,re-editing and displaying the re-edited execution screen as an initialexecution screen of the application. 8: The method of claim 1, furthercomprising: controlling an operation of the application based on acommand received from the first peripheral device. 9: The method ofclaim 1, wherein the source information comprises at least one of anexecution code and resource for executing the first region to betransmitted to the first peripheral device, and the extracting comprisesextracting source information relating to the first region by analyzingpredetermined source information relating to the first region and anexecution code for executing the first region. 10: A display devicecomprising: a communicator configured to perform data communication witha first peripheral device capable of communication; a display configuredto display an execution screen of an application which is divided into aplurality of regions; and a controller configured to: control thecommunicator to extract source information related to a first region,from among the plurality of regions, to be transmitted to the firstperipheral device; edit the execution screen based on a region otherthan the first region; transmit the extracted source information to theperipheral device; and based on transmitting the extracted sourceinformation to the first peripheral device, display the edited executionscreen. 11: The display device of claim 10, further comprising: at leastone sensor, wherein the processor is configured to identify, based onthe sensor, a position of the first peripheral device and identify, asthe first region, a region relating to the identified position. 12: Thedisplay device of claim 10, wherein the processor is configured toidentify, as the first region, a region based on device information ofthe first peripheral device. 13: The display device of claim 10, whereinthe processor is configured to identify, as the first region, a regionbased on device information of the first peripheral device and executioninformation of the plurality of regions. 14: The display device of claim13, wherein the processor is configured to, based on the first regionbeing a region for receiving a user command or for displaying userinformation, control transmitting source information of the first regionto the first peripheral device according to a first condition and, basedon a second region different from the first region being a region fordisplaying content, control transmitting source information of thesecond region to a second peripheral device according to a secondcondition.